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Abstract 

We describe an algorithm to enhance and binarize a fingerprint im- 
age. The algorithm is based on accurate determination of orientation 
flow of the ridges of the fingerprint image by computing variance of the 
neighborhood pixels around a pixel in different directions. We show 
that an iterative algorithm which captures the mutual interdepen- 
dence of orientation flow computation, enhancement and binarization 
gives very good results on poor quality images. 

Keywords: Fingerprint enhancement, fingerprint binarization, ori- 
entation flow. 

1 Introduction 

One of the most important tasks in an automatic fingerprint recognition 
system is enhancement of poor quality images [21 [6] . Enhancement leads to 
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better accuracy of the system as measured in terms of false rejection and 
false acceptance rates. Another important problem is binarization of the 
image into ridges and valleys, which allows for simple and fast binary image 
processing algorithms [6]. 

The starting point in most algorithms is that of accurate determination 
of orientation flow of a fingerprint image. In literature, one of the popular 
methods to compute the flow is based on gradient analysis, in which one 
computes second moment gradient matrix, also commonly known as structure 
tensor, in the neighborhood of each pixel to yield dominant orientation at 
each pixel [U HJ [7j . This approach works well if there is indeed a dominant 
orientation, but which is not the case in many regions of the image, especially 
if it is of poor quality. 

Accurate determination of orientation flow in such problematic regions 
of fingerprint images is the first major contribution of this paper. Ours is a 
completely spatial approach which does not use gradients. 

In literature, once the orientation flow is determined, authors have pro- 
posed several enhancement algorithms. Many use directional filtering and 
anisotropic diffusion methods |TJ EJ [7] or frequency domain methods [6] . Re- 
cently, probabilistic techniques have been also proposed [5]. 

We use directional filtering in our enhancement algorithm. Our filtering 
is faster as it uses short 1-D Gaussian filter as against 2-D Gaussian or 
Gabor filters commonly used in the past work. Furthermore, our algorithms 
for binarization and enhancement fit in the structure of our orientation flow 
algorithm so that they can be integrated. 

Conventionally, the three tasks of orientation flow determination, en- 
hancement and binarization tasks are performed sequentially. However it 
can be seen that these are mutually dependent on each other. For example, 
if we had an enhanced image, we could compute more accurate orientation 
flow, and vice versa. 

Motivated by this insight, we propose an iterative scheme and demon- 
strate that it gives excellent results. One important difference from the past 
work is that we perform binarization before enhancement. We demonstrate 
the performance of the proposed projection based iterative algorithm through 
examples. 
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2 Second Moment Matrix Based Approach 



Let I(p) be gray level intensity of a fingerprint image at location p G M 2 . 
Define a neighborhood Af around p. Compute the second moment matrix of 
gradients of pixel intensity in this neighborhood 

A = E V/(q) V Aq) T (1) 

Let the eigen-values of A be Ai > A2 > 0. Let the orientation angle of 
the dominant eigen-vector vi be 9 = tan _1 (vi a /vi a; ). The angle 9 is the 
orientation direction at pixel p, see [3] . Equivalently, 

0= i -J E qe Ar2(y/(q)),(y/(q)) i/ \ 

2 ^ \E qeA r((V/(q)), 2 -(V/(q)), 2 );' 

Often Af is weighted by a Gaussian function so that pixels closer to p 
have greater contribution. 

We show the problem with this popular approach in Figure [I] (a) in which 
we show a 25 x 30 subregion of a fingerprint image captured by an optical 
sensor. At many pixels there is no well defined dominant orientation due to 
overall poor quality of the image, which then leads to inaccurate orientation 
flow computation. We will show in next section how we can compute an 
accurate orientation flow as shown in Figure fl] (b). 



3 Projection Based Iterative Algorithm 
Orientation Flow 

Informally, for any point in the image, we take projections in its neighborhood 
in different directions and find the direction which gives minimum variance 
in pixel values. 

Consider neighborhood Af around p. Let L(p, a) C Af be the line segment 
passing through p at an angle a. Let q G L(p, a). Line L' = L(q, a + n/2) C 
Af is the line segment passing through q which is perpendicular to L(p,a), 
see Figure [2] (a). 

Denote the standard deviation of pixel values on this perpendicular line 

as 

er(q) = a(L') = A/Variance{/(r) : r G L'}. 
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(a) Second Moment Matrix Based Approach 
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(b) Proposed Algorithm (Projection Based) 
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Figure 1: Orientation flow determination, (a) Well-known method based on 
second moment gradient matrix, (b) Our proposed algorithm on the same 
area of the image. 
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Figure 2: (a) Computation of dominant orientation at pixel p in the finger- 
print image, (b) Binarization of the pixel p. 

Take the mean of the standard deviations over all such lines 

fjL Q = mean{cr(L / ) : L' = L(q, a + tt/2), q G L(p, a)}. 

Now we define dominant orientation at p to be the angle which gives mini- 
mum average of standard deviations over all angles a, plus 7r/2: 

7T 

9 = - + argmin{/i Q }. (2) 

We found that the best results are obtained when we divide the line seg- 
ment L' into two halves L\ and L' 2 which meet at q, as shown in Figure [2] (a), 
and compute standard deviations for these two line segments, and redefine 
a above as 

a(q) = min{or(L / 1 ),(x(L / 2 ),o-(L / )}. 

The reason why this gives better result is because even when a point is at the 
end of a ridge, we need to look at only the half of the neighborhood which is 
towards the ridge and ignore the other half. 

See Figure [I] (b) for results of our proposed algorithm. 

We mention few speedup tricks we employed to make the algorithm fast: 

1. The orientation flow is not computed at all points p, but only at sub- 
sampled set. We computed it at every other pixel in x and y directions 
yielding speedup factor of 4. At other positions, one can interpolate 
the angle. 
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2. The minimum in Equation ([2]) is obtained by considering a from to 
7r in increments of 7r/8. Then we refine this estimate 9 by considering 
smaller increments of 7r/32 in the range [9 — 7r/16, 9 + 7r / 1 6] . 

3. We rotate the image once for each angle a. Then we pre-compute /(x) 2 
for each pixel x. This makes computation of standard deviations fast. 



Binarization 

Informally, to compute the binary value of any pixel one has to check if the 
greyness values of pixels in the dominant direction is less or more than the 
values in the orthogonal direction. A related though not same idea is used 
in [6]. For each point p with dominant orientation 9, we compute the average 
greyness values along the line segments passing through it at angles 9 and 
9 + |, as shown in Figure [2] (b): 



g = mean{/(q) : q G L(p,9)}, 

71 

h = mean{/(q) : q G L(p, 9 + — )}. 



The binary value at p is given as follows 

B(P) = 



0, if g < h 

1, otherwise 



Enhancement 

Given the orientation flow and the binary image, we can enhance the image 
as follows. Informally, for any point we apply a smoothing filter along the 
dominant direction at those neighboring points which have same binary val- 
ues as the given point. Consider the sequence of points along line segment 
L(p, 9) which have binary value -B(p). Apply a 1-D Gaussian filter on these 
points to get the enhanced image J as 

J(p) = Q{a) * (q G L(p, 9) : B(p) = B(q)) 

where Q{cr) is Gaussian filter of standard deviation a, which we chose to be 
3, and which is always normalized to have sum 1, since some q will not be 
considered if -B(p) ^ B(q). 
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Nonlinear Isobrightness Contours 



As an advanced option of our algorithm, we generalize the line L(p, 9) to a 
non-linear smooth curve C(p) which is the iso-brightness contour at p. The 
points just next to p on this curve are: 

Pi = p + (cos0p,sin0 p ), 
P2 = P - (cos0p,sin0 p ). 

where we denote the dominant orientation at p by 9 p . The binarization and 
enhancement algorithm remain same except that we now use C(p). At most 
pixels, L(p, 9) is very good approximation of C(p). 

Iterative Algorithm 

As we emphasized in the Introduction of this paper, we view orientation flow 
determination, binarization and enhancement to be three mutually interde- 
pendent components of overall algorithm, see Figure [3] (b). In Figure [3] (a), 
we show the conventional scheme. Therefore, we explore this novel approach 
by applying two iterations of our algorithm i.e. given an image /, once we 
have computed its orientation flow, binarized it, and enhanced it to give im- 
age J, then we repeat the whole process again with the enhanced image J 
as the input, as illustrated in Figure [3] (c). 

4 Results 

In Figure [4], we show the results of our algorithm on three different kinds of 
fingerprint images, captured by optical, capacitive and thermal sweep sensors, 
see FVC 2002 and 2004 for the datasets [Hj. The results on subregions of the 
images are shown in detail. We used linear approximation to iso-brightness 
contours for speed and because our experiments indicated that it gives results 
comparable to the non-linear case. Visual inspection of our results indicates 
that the algorithm is fairly robust as it works on all three types of sensors. 
We are able to reproduce the ridges very well, even in the case of capacitive 
sensor image which is of quite poor quality. One can detect minutiae in 
binarized images through the operation of morphological skeletonization or 
some other binary operations. 
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Figure 3: (a) Conventional method to enhance and binarize a fingerprint 
image, (b) Mutual dependence of subtasks on each other, (c) Our imple- 
mentation of mutual dependence using an iterative scheme. 



5 Conclusions and Future Work 

We presented a novel, fast and robust algorithm to accurately compute the 
orientation flow of a fingerprint image and to binarize and enhance the im- 
age. Our algorithm for orientation flow significantly outperforms well-known 
method based on second moment matrix. We also showed very good results 
of binarization and enhancement algorithms on images captured by different 
kinds of sensors. 

We believe ideas in this paper can be improved and optimized in future 
research in several ways. We are currently implementing a complete finger- 
print recognition system based on this paper whose results will be described 
in a forthcoming publication. The mutual interdependence of different com- 
ponents of the algorithm as captured in the iterative algorithm needs to be 
understood more rigorously on a wide variety of fingerprint images. 
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Figure 4: In the left column, we show results on an image captured by an 
optical sensor, and in the middle column, by a capacitive sensor, and in the 
right column, by a thermal sweep sensor. We show results in the selected 
subregions of the images. The top row shows the original images, the middle 
row shows the binarized images and the bottom row shows the enhanced 
images. 
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